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DESCRIPTION 

CODING METHOD AND APPARATUS, AND COMPUTER PROGRAM Ma> 
COMPUTER-READABLE STORAGE MEDIUM 

5 TECHNICAL FIELD 

The present invention relates to data coding, and 
more par tlcu larly , to a coding technique for encoding 
distribution data in multidimensional space such as a 
two-dimensional image and three-dimens.ional density 
10 distribution data. 

BACKGROUND ART 

As a general technique for encoding 
multidimensional distribution data, such as a two- 

15 dimensional image, a data amount compression technique 
such as a - JPEG coinpression technique Is known. Two- 
dimensional image data is subjected to discrete cosine 
transform then- quantization, and encoding by the 
Huffman coding or the like. 

20 Further, a method for predictive -encoding image 

data, block-dividing prediction error data by the 
predictive coding, and determdLning whether or not each 
block has a large amount of prediction error or small 
amount of prediction error is known (for example, 

25 Japanese Patent Application Laid-Open No. Hei 11- 
331852 ) • According to the method disclosed by the 
document, vector quantization is applied to a block 
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with a large amount of prediction error, then the 
difference value between a vector value of a codebook 
retrieved by the vector quantization and the prediction 
error is calculated, then the difference veaue and the 
5 prediction error in a block with a small amount of 

prediction error are entropy- encoded, and coded data is 
generated by using the entropy code, a block error- 
amount discrimination flag and an index by vector 
quantization. In this manner, from the viewpoint of 
10 space- saving data conservation and highr-speed 

communication, a high efficiency data coding technique 

is desired. 

Further, in an arithmetic unit to perform 
discrete convolution on a two-dimensional image 

15 represented by predetermined two-dimensional weight 
distribution data, which is frequently used in image- 
processing such as filtering, accelerated computation 
is escpected by use of a large- scale parallelized 
product -sum arithmetic elements. However, the product- 

20 sum operation by two-dimensionally parallelized 
arithmetic elements cannot be realized without 
difficulty due to wiring problem and the like. 
Accordingly, a method for decomposing two-dimensional 
weight distribution data into one-dimehslonal base 

25 group for convolution is desired. 



DISCLOSURE OF INVENTIC»I 



wo 2005/074145 PCT/JF200S/001289 

- 3 - 

The present invention has been made in 
consideration of the above situation, and provides a 
high-efficiencsy data coding technique, particularly for 
encoding distribution data in multidimensional space 
5 such as a two-dimensional image by decomposing the data 
to several one^dlmensional bases. 

According to the present invention, provided is a 
method for encoding n.data to be encoded, into data 
representing a base« comprising: 
10 a setting step of setting the base; 

a reconstruction step of reconstructing n data by 
using the bases; 

an error calculation step of calculating an eirror 
hetween the n data to be encoded and the reconstructed 
15 n data by using a pzredetezmined error evaluation 
function; and 

a correction step of correcting the base based on 
the error • 

Other features and advantages of the present 
20 invention will be apparent from the following 

. description taken in conjunction with the acconqpanying 
drawings, in which like reference characters designate 
the same name or similar paxrts throughout the figures 
theareof. 

25 

BRIEF DESCRIPTION OF DRAWINGS 
The accompanying drawings « KAiich axe Incozpoirated 
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JLn and constitute a part of the specification, 
illustrate eml>odiments of the invention and, together 
with the description, serve to explain the principles 
of the invention. 
5 Fig. 1 is a flowchart showing coding processing 

according to a first embodiment; 

Fig. 2 is a flowchart showing coding processing 
according to a second embodiment; 

Fig. 3 is a flowchart showing coding processing 
10 according to a third embodiment; 

Fig. 4 is a flowchart showing coding processing 
according to. a fourth embodiment; 

Fig. 5 is a schematic diagram showing an example 
of two-dimensioneO. image including simple rectangles; 
15 Fig. 6 is an explanatory diagram showing a 

conventional structure for transmission of two- 
dimensional weight distribution data; 

Fig. 7 is an escplanatory diagram showing a 
structure for transmission of two -dimensional weight 
20 distribution data in a convolution arithmetic unit to 
perform product -sum arithmetic method according to a 
ninth, embodiment; 

Fig* 8 is a block diagram showdLng an apparatus 
construction according to the first embodiment; 
25 Fig, 9 is an explanatory diagram showing a 

structure for transmission of two-dimensional weight 
distribution data in the convolution arithmetic unit to . 
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perform the product- sum arithmetic method according to 
the ninth embodiment; 

Fig. 10 shows 8x8 luminance value data 
corresponding to Input Image In a numerical example 
5 using particular numerical values; 

Fig. 11 shows an Initial one-dimenslonal adaptive 
base group In the numerical example; 

Fig. 12 shows an array o£ 8x8 numerical values 
corresponding to a reconstructed Image £Tom the Initial 
10 one-dlmenslonal adaptive base group In the numerical 
example; 

Fig. 13 shows first correction amounts for a one- 
dlmenslonal adaptive base group with a base number "0" 
In the numerical example; 
15 Fig.- 14 shows the one-dlmenslonal adaptive base 

group with the base number ^"0" after the first 
correction In the nximerlcal example; 

Fig. 15 shows the dne-dlmenslonal adaptive base 
group with the base number "0" after the second 
20 correction In the numerical example; 

Fig. 16 shows the one-dlmenslonal adaptive base 
group with the base number "0" after the ninth 
correction In the numerical example; 

Fig. - 17 is a line graph showing changes of error. 
25 K to the corrections on the one-dlmenslonal adaptive 
base group with the base number "0" in the numerical 
example; 
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Flsr* 18 shows the one-diJiienslonal adaptive base 
group with the base number "0" after a convergence of 
the error E In the ntunerlcal exan^le; 

Fig* 19 shows the array of 8x8 numerical values 
5 corresponding to the reconstructed Image from the 
Initial one-dlmenslonal adaptive base group with the 
base number "0", after the convergence of the error E 
In th^ numerical example; 

Fig. 20 shows an array of 8x8 numerical values 
10 corresponding to a difference coded image after 
completion of correction of the one-dlmenslonal 
adaptive base group with the base number "0", after the 
convergence of the error E, in the numerical example; 

Fig. 21 shows the first correction amounts for 
15 the one-dlmenslonaJL adaptive base group wllih a base 
number "1" in the numerical example; 

Fig. 22 shows the second correction amounts for 
the one-dlmenslonal adaptive base group with the base 
number "1" in the numerical example; 
20 Fig. 23 shows four one- dimensional adaptive base 

groups after completion of correction in the numerical 
example, and axrrays of 8x8 numerical values 
corresponding to decoded Images reconstructed from the 
base groups; 

25 Fig. 24 shows an exainple of an input image 

according to the second embodiment; 

Fig. 25 shows an exanple of decoded images 
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according to the second embodiment; 

Fig. 26 shows an example of decoded Images In a 
case where the precision Is rounded according to the 
second embodiment; 
5 Fig. 27 shows an exanq^^le of a decoded Image 

obtained by dividing an input image and performing 
coding and decoding, according to the second 
embodiment ; 

Fig. 28 shows an example of a decoded image 
10 according to the third embodiment; and 

Fig. 29 shows quantization coefficient vectors 
according to the third embodiment* 

BEST MODE FOR CARRYING OUT THE INVENTION 
15 Preferred embodiments of the present Invention 

will now be described in detail in accordance with the 

accompanying drawings. 

<Fir8t Embodlment> 

As a first embodiment, a method for encoding a 
20 two-dimensional gray- scale image, defined In a finite 

range, to two one -dimensional adaptive bases will be 

described. Note that in the respective embodiments, 

the adaptive base will also be singly referred to as a 

"base" . 

25 Fig. B Is a block diagram showing an apparatus 

construction according to the first embodiment. 

In Fig.. 8, reference numeral 1 denotes a CPU 
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Which controls the overall apparatus; 2, a ROM in which 
a processing procedure (program) for the CPU 1 is 
stored; and 3, a RAM used as a work area for the CPU 1, 
in which an dLmage data eu:ea 3a for storing image data 
5 to be encoded and an area 3b for storing base data are 
ensiured. Note that the sizes of the areas 3a and 3b 
are determined in correspondence with the size of input 
image data. Numeral 4 denotes an image input unit 
which inputs a gray-scale image data to be encoded. As 

10 the image input, an image sensing device or the like 
may be used. In a case where image data is stored in a 
storage medium, a device to access the storage medium 
may be used as the image input unit. Otherwise, in a 
case where an Image is received via a network, a 

15 network interface may be used as the images input unit. 
Numeral 5 denotes an external storage unit (hard disk 
or the like) in vghich coded data is stored- In a case 
where coded data is output ted onto a network, a network 
interface may be used. 

20 In the present embodiment, for the sake of 

simplification of explanation, image data to be encoded 
is handled as a 1 -pixel- 8 -bit multivalue (gray-scale) 
monochrome image. (If the image data represents a 
color image, coding to be described below is repeated 

25 in correspondence with the number of components of the 
color image.) Further, the image has a rectangular 
shape where the number of pixels in a horizontal 
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direction is and thie number of pixels In a vertical 
direction is yoajK. In a case where the image input unit 
4 is an image scanner, the number of pixels Xn«x and y,nax 
are uniquely determined respectively based on a reading 
5 resolution and an original size. 

Input image data is stored into the image data 
area 3a. At this time« the pixel value of a coordinate 
(x,y) (Note that 0^<XcaEuc and 0^<Yna^ hold) is expressed 
as f(x,7). For example, in a case where data in k- 
10 dimensional space is handled « the data is expressed as . 
X2, Further, as the size of the input 

image data is deteTnnined, two one-dimensional adaptive 
bases X(x) and Y(y) are allocated in the base area 3b. 
.6ach one-dimensional adaptive base can be regarded as a 
.15 continuous or discrete one-dimensional sequence of 

numerical values. Further, if the continuous sequence, 
of numerical values are amplitude values, the sequence 
of numerical values can be regarded as a waveform. The 
ranges of "x" and "y" are the same as those of the 
20 input image. Note that the pixel value f (x,y) is an 8- 
bit (1 byte) integer value, and the one -dimensional 
adaptive bases X(x) and Y{y) are ensiired in multi-byte 
format in the base area 3b of the RAM 3 for storage of 
decimal place values. 
25 Hereinbelow, a coding processing procedure of the 

CPU 1 according to the first embodiment will be 
described with reference to the flowchart of Pig. 1 



wo 2005/074145 



PCT/JP2005/001289 



( the coxxespondlng program Is stored In the ROM 2 ) • 

Firsts In image data Input (step SIO), an image 
f (x,y) as a two-dimensional gray-scale image to be 
encoded is Inputted and stored in the image area 3a. 
5 Next, base setting is performed (step Sll). At this 
step, initial values of the two one-dimensional 
adaptive bases X(x) and Y(y) are set. Note that as the 
one-dimensional adaptive bases X(x) and Y(y) , values 
which are not "0" in the limited ranges 0^<XmaB, and 

10 0^<yBiax are set. In this initial stage, the values are 
set by using random functions • Note that in this 
embodiment, the respective definition ranges are 
limited as above, however, the definition ranges cire 
not limited to such limited ranges. That is, even if 

15 f(x,y), X(x) and Y(y) are defined in indefinite 

definition ranges, the present method is applicable 
(however, there are limitations since the memory 
capacity is finite) unless an error E and correction 
amounts AX(x) and AY(y) to be described later diverge. 

20 In base reconstruction processing (reconstruction 

processing f:i:om a group of adaptive base] (step S12), a 
reconstructed image f(x^y) is generated (reconstructed 
image from a group of adaptive bases) as follows. 

25 f{x,y)^X(^yY{y) 

Next, in error calculation processing (step S13), 
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an exxor B between the input image f(x,y) and the 
reconstructed image /(x,y) is calculated by using the 
following error evaluation function. 



is similarly performed regarding the y component, the 
10 error B is an accumulated error in the entire area of 
the input image. Further, as the error E is xised in 
error convergence determination (step S16 as branch 
determination) to be described later, it is 
seguenti€d.ly stored as a record in the RAM 3. 
15 Next, based on the error E, correction amounts 

for the respective one-dimensional adapltive bases are 
calculated (step S14), The coxrrection amounts AX(x) 
and AY(y) are calculated as follows.. 




Note that /f (x)dx meeins an integrated value of 
f (x) in the entire x definition range. As integration 



20 



Note that correction parameters tjx and tjy eire 
positive constants, (setting, of the parameters r\x and % 
will be described later) . . 
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The functions to obtain the correction amounts 
are partial differentiation of the expression to obtain 
. the error E , That is , the error E always has a value 
greater than "0", and in the ultimate sense, the object 
5 of the present ^bodlment is to obtain one -dimensional 
adaptive bases with a minimum error E. In a case where 
the slope in the current one -dimensional adaptive base 
is minus, a m-in-imnm value one -dimensional base is 
positioned In the positive direction from the current 
10 point, while in a case where the slope in the one- 
dimensional adaptive base is plus, a minimum value one- 
dimensional base is positioned in the negative 
direction form the current point. Accoirdingly, 
multiplying the slope by minus gives a correction 
15 amoimt corresponding to the slope. 

Next, at step S15, correction processing is 
performed on the respective bases. That is, the 
correction amounts AX(x) and AY(y) obtained at step S14 
are added to the .uncorrected one-dimensional adaptive 
20 bases X(x) and Y(y), thereby corrected one-dimensional 
adaptive bases X'(x) and Y'{y) are obtained. The 
processing is expressed as follows. 
X'(x)»X(x)+AX(x) 
Y'(y)«Y(y)+AY(y) 
25 Upon correction of one- dimensional adaptive bases, 

the above-described condition "the respective one- 
dimensional adaptive bases are always not ""O" as long 
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as the Input Image f (x^y) Is always not "0" in the 
entire defined x and y ranges" onlst be satisfied. Note 
that if such condition is satisfied, minute 
fluctuations can be applied to at least a part of the 
5 one-dimensional adaptive bases in a random manner. 

The above-described correction on one-dimensional 
adaptive bases at step S12 (base reconstruction 
processing) to step S15 (base correction processing) is 
repeatedly pexrf ormed until completion detexmination is 
10 made at step S16 at which error lower limit is 

determined and at step 17 at which error convergence is 
determined; 

In the error lower limit determination at step 
S16, if the error E of immediately previous correction « 

15 calculated in the error calculation (step SIS), is 
equal to or less than a predetermined value, it is 
determined whether or not the one-dimensional adaptive 
bases produce an ejcror E within the allowable range. 
If the above completion detexmination is made, the one- 

20 dimensional adaptive bases at that point are recorded 
as coded data, and the process ends. 

Further, in the error convergence determination 
at step S17, it is determined whether or not the error 
has converged based on the recorded error E calculated 

25 in the error calculation (step S13). If it is 
determined that the error has converged, the 
determination that the one -dimensional adaptive bases 
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at that time produce a minimum error value Is outputted, 
and the process ends. The one-dimenslonal adaptive 
];)ases upon determination of convergence are recorded as 
coded data of the input image f(x,y)- As the 
5 determination of error convergence, if a status where 
the error E has almost no change (the error difference 
is equal to or less than a predetermined threshold 
value) in each correction has continued, it is 
determined that the error has converged « 

10 By the above-described processing, the two- 

dimensional iaultivalue (gray-scale) image f (x,y) can be 
encoded to data expressed by two one- dimensional 
adaptive beises X(x) and Y(y). In other words, as the 
image data f (x,y) having pixels Xoax^nax is reduced, to 

X5 the coded data expressed by x^-fynax, it cah be assumed 
that the initial data is compressed (note that since 1 
pixel of the input image corresponds to 8 bits, while 1 
element of one-dimensional adaptive base corresponds to 
' several bytes, the conq^ression ratio cannot be 

20 specified simply by the number of data) , Further, a 

decoded image f decode (x,y) corresponding to the coded two 
one-dimensional adaptive bases X(x) and Y(y) is 
obtained based on the following escpression. 
fdecode(x,y)=X(x)xY(y) 

25 In the above coding processing, the initieO. one- , 

dimensional adaptive bases X(x) and Y(y) set in the 
base setting at step Sll are, preferably, values about 
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Within the defined x and y ranges of the input image* 
Preferably, if values which are not "O" but 
approximately "0*" are set, initial value dependency is 
reduced and appropriate one-dimensional adaptive bases 
5 can be obtained with high probability. 

Further, psreferably, the correction parameters tiz 
and Tjy are determined in correspondence with the range 
of the input image f (x,y) and determined x and y ranges. 
More particularly, it is preferable that the parameter 

10 tlx is in inverse proportion to the. second power of the 
y range and the range of the input image f (x,y) , and 
the parameter tjy is in inverse proportion to the second 
power of the x range and the range of the input image 
f(x,y). In thiis embodiment, the correction parameters 

15 Tlx and r\y are changed in accordance with the respective 
one-dimehsional adaptive bases, however, the same value 
may be used if the defined x and y ranges are 
approximately the same* If the correction parameter is 
set to a great value, the completion determination in 

20 the error lower limit determination (step S16) or in 
the error convergence determination (step S17) can be 
made with high probability by a reduced number of . 
correction of one-dimensional adaptive bases. However, 
. there is a high probability that the exn:t>r E greatly 

25 fluctuates around a minimum value and appropriate one- 
dimensioiial adaptive bases cannot be obtained. Further, 
if the correction parameter is set to a. small value. 
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the error B around ai minimum value can be obtained and 
appropriate one-dimensional adaptive bases can be 
obtained with high probability. However « there is a 
high probability that a large number of correction of 
5 one-dimensional adaptive bases is required until the 
completion determination is made in the error, lower 
limit determination (step S16) or in the error 
convergence determination (step S17)- In view of the 
above points, it is preferable that the correction 

10 parameter is set to a small value not to cause great 
fluctuation of the error E around a minimum value and 
not to require an extremely Isurge number , of correction 
of one -dimensional adaptive bases. Further, a method 
to gradually reduce the correction parameter in 

15 accordance with the number of corrections may be 
applied. 

Further, it is preferable that the previously- 
determined allowable range of the error B, used in the 
error lower limit determination (step S16)., is 

.20 determined in correspondence with the range of the 

dLnput image f (x,y) and the defined x and y ranges. If 
the error E is set to a great value, the completion 
determination in the error lower limit determination 
(step SI6) can be made with high probability by a 

25 reduced number of correction of one-dimeixsional - 

adaptive bases. However, there is a high probability 
that the one-dimensional adaptive bases with high error 
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E value are obtained. On the other hand* 1£ the error 
E is set to a small value, appropriate one-dimensloneO. 
adaptive bases with lower error E value are obtained 
with high probability. However, there is a high 
5 probability that a greater number of correction o£ one- 
dimensional, adaptive bases is required by the 
conqpletion determination in the error lower limit 
determination (step SI 6) or completion determination is 
not made in the ezrror convergence determination (step 
10 S17). 

Further, in a case where the correction amounts 
AX(x) and AY(y) are calculated in the above -described 
correction amount calculation (step S14) as follows, by 
using previous cozrrection amounts' AX(^x\AY(y) , there is 
15 a high probability that more appropriate one- 
dimensional adaptive bases with less error value cab be 
obtained, or desired one -dimensional adaptive bases can 
be obtained with a reduced number of corrections. 

^{^h% 'j\fM- fM\ Y(y)dy +€r, ^AX{x) 
AF(y)» I,, -/{f 7(x,7)}x(r>fc+ a, • AF(y ) 

Note that momentum constants Ox and Oy are 
integer constants less than "1°. In the present 
embodiment, the diomentum constants are changed in 
25 accordance with the respective one -dimensional adaptive 
bases, however,, the same value may be used. If the 
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• momentum constant Is set to a great value, the above 
advantages are obtained with high probability, however, 
adverse effects also appear and the correction of one- 
dimensional adaptive bases may become unstable with 
5. high probability. Accordingly, the momentum constant 
set to an extremely large value is not preferable. On 
the other hand, if the momentum constant is set to a 
small value, the probability of appearance of adverse, 
effects is lowered, howeveo:, the probability to obtain 

10 the above advantages is lowered. Accordingly, it is 

preferable that the mcmientum constant is set to a value 
as large as possible within a range where the 
correction of one-dimensional adaptive bases is stable. 
The first embodiment has been described as an 

15 example of coding of two-dimensional gray-scale image 
f (x,y) into two one- dimensional adaptive bases X(x) and 
Y(y) • however, the image to be encoded is not limited 
to a two-dimensional image. For example, the above 
coding is applicable to density ddLstribution in three- 

20 dimensional space, or applicable' to multidimensional 
space higher than the three-dimensional space. In a 
case where an object in three-dimensional space is 
encoded, the object can be encoded to three one- 
dlmensional adaptive bases X(x) , Y(y) and Z(z). 

25 

<Second Embodlment> 

In the above-described first embodiment, as long 
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as a two-dimensional image to be encoded Is - 
comparatively simple « error-reduced coding can be 
realized by appropriately selecting a coordinate system* 
That is, .as long as the two-dimensional Image comprises 
5 simple rectangular shapes as shown in Fig. 5, coding 
with comparatively small error can be realized by using 
an O3cthogonal coordinate system orthogonal to the 
rectangles. In this maxmer, by appropriately selecting 
a polar coordinate system or the like in correspondence 

10 with data, or by selecting a columnar coordinate system 
or the like for three-dimensional data, coding with 
reduced error E can be realized. 

However, in a case where a two-dimensional image 
which is a natural, image is encoded by the method 

15 according to the above- described first embodiment, the 
error between data (image data) decoded by using coded 
data and original data becomes large. Accordingly, in 
the present embodiment ir a method. for encoding a 
discrete two-dimensional gray-scale image f (3C,y) 

20- defined in a finite rcuige into plural group of discrete 
one-fl 1 menslonal adaptive base groups Xi(x)^ Yi(y)(x and 
y are integers) will be described as a modification to 
the. first embodiment. 

The outline of the second embodiment will be 

25 described. One one -dimensional adaptive base group is 
subjected to similar processing to that of the first 
embodiment, and subjected to the lower limit 
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determination of error E and convergence determination. 
Then, if it is not determined tbat the error E is 
sufficiently small, a new one -dimensional adaptive base 
group is added (allocated), and the same prpcessing is 
5 repeated so as to reduce the error between the coded 
data and decoded data. 

In the present embodiment, the apparatus 
construction is the same as that of the first 
embodiment. Hereinbelow, the processing according to 

.0 the second embodiment will be described with reference 
to the flowchart of F±g. 2. 

First, in image input (step S20), an input image 
f (x,y) as a discrete two-dimensional gray-scale image 
to be encoded is Inputted- As in the case of the first 

15 embodiment, x and y have predetermined definition areas, 
0^<x^ and O^Ky^nasL* Further, in the second embodiment, 
the input image is discrete, and x and y are integers. 

As a particular example, processing perfoimed on 
8x8 luminance value data as shown in Fig- 10 will be 

20 described- Hereinbelow, the example using particular 
numerical values will be referred to as a numerical 
• exainple. The numerical values in Fig. 10 are non- , 
negative integers in 8-bit precision, however, any data 
may be employed as long as difference 1>etween the 

25 values can be defined. Following the image input (step 

520) , the base setting processing is performed (step 

521) - One of discrete one-dimensional adaptive base 
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group Xi(x), Yx(y)(x and y are Integers) is selected 
and set as an initial one- dimensional .adaptive base 
group* "The suffix "1" is a base number* In the 
present embodiment, although the base number is not 
5 particularly limited, the base number is sequentially 
selected from "0** to a predetermined number. As the 
image subjected to processing in the numerical exan^le 
is an 8x8 luminance value data, each of the one- 
dimensionail adaptive bases is a sequence of numerical 

10 values having 8 elements. As described in the first 
embodiment, it is preferable that approximately "0" 
random numbers are set as initial numerical ved^ues. 
However, in the initial one-dimensional adaptive base 
group having suffix "I", a one- dimensional adaptive 

15 base group as shown in Fig. 11 is used merely to 

satisfy the condition that all the elements are not "0°, 
for the sake of simplification. In Fig. 11, the value 
of bracketed "t" indicates the number of .corrections on 
one-dimensional adaptive base. That is, if t^n holds, 

20 the one-dimen8ipn€a adaptive base has been corrected n 
, times • 

Next, the base reconstruction processing is 
performed (step S22). A reconstructed image /|(x,y) is 
calculated as follows. 

25 
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Pig^ 12 Shows an array of 8x8 numerical values 
corresponding to a reconstructed Image /o(x,y) 
immediately after the base setting processing {step 
S21) using the initial one-^dimensional adaptive base 
5 group- Next, the error E is calculated as follows by 
error calculation (step S23). 



10 In the above expression, fi(x) is a difference 

coded image escpressed as follows. 

/-I - 

fiix,y)^fix,y)-^f„ix,y) 

15 Note that ^f(x) means summation of f(x) when x 

X 

is an integer, in the entire x definition range - 

m 

Further, liner summation of fk(x) 

when n ^tesm holds. If m<n holds, the result of 
summation is 0. In the numerical example, as the 
20 difference coded image fo(x) becomes an input image, 
the error E is "482913". 

The above difference coded image fi(x,y) means 
the resuit of subtraction of the respective 
reconstructed images, reconstructed from one one- 
25 dimensional adaptive base group, having the base number 
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"0" to "1-1"^ from the input Image f(x,y). That Is, in 
the second embodiment, as the respective one- 
dimensional adaptive base groups are corrected while a 
one-dimensional adaptive base group is sequentially 
5 selected from the base number "0", the difference coded 
image fi(x,y) corresponds to the result of subtraction 
of the respective reconstructed images, reconstructed 
from the correction-completed one-dimensional adaptive 
base groups, from the input image f(x,y)« 
10 Next,, in the correction amount calculation (step 

S24), correction amounts AXx(x) and AYi(y) for the one- 
dimensional adaptive base group Xi(x) , Yi(y), selected 
in the base setting (step S21), are calculated as 
follows • 

15 

Otherwise, the correction amounts may be 
calculated by using the following expressions where the 
20 previous correction amounts AX(x\AY(y) are multiplied 
by the momentum constants ct^, cXy described in the first 
embodiment are added. 
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Ali(y)«^9, *^+a, -AYCy)-!,, -^i^iM-^^yd-^iC^^^ 'A^W 

••.(2) 

In tiie above expressions # t|x and tjy are 
5 correction parameters similar to those described in the 
first emb9diment • 

In the numerical example, the correction amounts 
are calculated by using the e3qE>ression (2). In the 
case of correction amounts for the one-dimensional 

10 adaptive base group shown in Fig. 11, i.e., inmiediately 
after the base setting processing (step S21), the 
values of the momentum constants are "0" since all the 
elements of the previous correction amount's ^X(x),LY(y) 
are "0". Fig. 13 shows the correction amounts in this 

15 case. In the figure, the value of bracketed "t" 

indicates the numbe;r of corrections. That is, if ten 
holds, the correction amounts corresponds to the n-th 
one "dimensional adaptive base correction. As the 
correction parameters in this case, Tix=T|y=0. 00078 holds, 

20 and as the momentum constants, holds. 

In the base correction (step S25), assuming that 
corrected one-dimensional adaptive base group is X'i(x), 
Y'i(y), and uncorrected one-dimensional adaptive base 
group is Xi(x) , Yi(y) , the respective one-dimensional 



wo 2005/074145 



PCT/JP200S/001289 



adaptive base groups are corrected by using tbe 
correction amounts AXi(x) and AYi(y) calculated as 
above as follows. 

5 i^'(y)=y,(y)+Ay,(y) 

The result of this correction on the one- 
dimensional adaptive base group shown in Fig. 11 is as 
shown in Fig. 14. In the first correction, since all 

10 the elements of the initial one -dimensional adaptive 
base group are "0"* except one element « only a part of 
the elements hajs been corrected. Further, as the 
numerical value other than. "0" is comparatively small, 
"0.1", the first correction amounts are vei^r small. 

15 Preferably, random numbers are set as the numericeil 

values, and all the elements euce corrected in the first 
correction. However, since it is desirable that 
initial values are approximately "0", the correction 
amounts are small. Then the error E is calculated 

20 based on the expression (1) by , using the corrected one- 
dimensional adaptive base group, and the value 
"482911.48" is obtained. The error E is slightly 
reduced in the first correction. As in the case of the 
first embodiment, such coxxection is repeatedly 

25 pezrformed until the completion determination is made in 
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the eirror lower limit determination (step S26) or the 
convergence determination is made in the error 
convergence determination (step S21) , thereby the one- 
dimensional adaptive base group having the base number 
5 selected in the base setting (step S21) is corrected^ 
For example, after the correction with the first 
correction amounts as shown in Fig* 13, the second 
correction amounts are as shown in Fig. 15, and the 
error E is "482906.05". In the second correction, 

10 although the correction amounts are very small, all the 
elements are corrected. In this numerical example, the 
seventh to tenth correction amounts are comparatively 
legrge. For escample, the ninth correction amounts are 
as shown in Fig. 16. The error E Immediately before 

15 the ninth correction is "286696.02", and the error 
immediately after the ninth correction is greatly 
reduced to "16349.27" • Fig. 17 shows the relation 
between the corrections and the changes of the error E. 
As shown in Fig. 17, the error E is reduced by each 

20 correction in an accelerative manner, from the first to 
ninth corrections. Then the eirror is temporarily 
increased, then, the error, with fluctuations, is 
gradually converged. The sudden increase after the 
ninth correction is caused by the influence of momentum 

25 constants. If the momentum constants are set to "0", 
such increase does not easily occur, however, above 
processing is effective for. reduction of the number of 
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coirxectlons by the convergence and for avo±dance of a 
trap to a local minimum value. 

The error lower limit determination at step S26 
and the error convergence determination at step S27 are. 
5 the same as those described in the first embodiment . 
In the error lower limit determination at step S26, if 
con^letion determination has been made, the number of 
base groups selected and corrected by that time and 
those one-dimensional adaptive base groups are recorded 

10 as coded data, and the process ends. In the above 
numerical example, the error is still large at this 
stage and sufficient approximation is not made. For 
exan^le, if the error lower limit is "100", the 
completion determination is not made. If the 

15 . couplet ion determination has not been made, the process 
proceeds to the next error convergence determination at 
step S27, at which it is determined whether or not the 
error E has converged. In the numerical example, when 
correction has been peirEormed about 30 times, the esncor 

20 E has approximately converged, to about "16199". Pig. 
18 shows the one-dimensional adaptive base group when 
the error E has converged. Further, Fig. 19 shows the 
array of 8x8 numerical values corresponding to the 
reconstructed image fo(x^y) from the one-dimensional 

25 adaptive base group. In the figure, the number of 
corrections of one-dimensional adaptive base "t-«" 
means that correction has been repeated such that the 
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error B has converged. 

In the first embodliaent , if It is determined that 
the error E has converged in the error convergence 
determination at step. S27 , conq^letion determination is 
5 made and the process ends. However, in the second 
embodiment, the process proceeds to difference 
calculation processing at step S28. If it is not 
determined that the error E has converged, the process 
returns to the base reconstzruction at step S22, in 
10 which correction is repeatedly performed on the one- 
dimensional adaptive base group with the selected base 
number. 

If it is determined that the erscor E has 
converged, then in the difference calculation at step 
15 S28, a reconstructed image reconstructed from 

the one-dimensional adaptive base group with the base 
number "1" is calculated by 

20 

and a difference coded image fn.i(x,y) is generated by 

25 In the above -described numerical example, as 1«0 

holds, the difference coded image fx(x,y) is the result 
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Of simple subtraction of tibie reconstruction image 
/o(*>y) ' reconstructed from the one -dimensional adaptive 
base group with the base number "0", from the Input 
Image f(x,y). Fig. 20 shows an array of 8x8 numerical 
5 values corresponding to the difference coded image 
fi(x.y)- 

Next, In the base number determination at step 
S28, If It Is determined that the number of cozrrectlon 
completed base groups has become a predetermined number, 

10 completion determination is made* Then the number of 
selected and corrected beuse groups by that time and 
those one-dlmenslonal adaptive base groups are recorded 
as coded data, and the process ends* If It Is 
determined that the number of correction conipleted base 

15 groups has not become the predetermined number, the 
process returns to the base setting at step S21, in 
which a new one-dlmenslonal adaptive base group is 
selected, and the processing from the base 
reconstruction at step S22 to the error convergence 

20 determination at step S27 is repeatedly performed, thus 
correction on the newly- selected one-dimensional 
adaptive base group is performed. 

In the above-described numerical example, since 
correction has been completed regarding only one group, 

25 If an allowable number of base groups is set to, e.g., 
"4**, as the number of correction completed groups hcui 
not become the predetermined number, the process 
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returns to the base setting (step S21). Then the next 
one -dimensional adaptive base group having the base 
number "1" is selected, and correction is performed on 
the one-dimensional adaptive base group in accordance 
5 with the expression (2) by using the difference coded 
image fi{x,y) obtained in the difference calculation 
(step S28); 

As described above, as the initial one- 
dimensional adaptive base group is as shown in Fig. 11, 

10 the one-dimensional adaptive base group with the base 
number "1" selected here is the same as that shown in 
Fig. 11. At this time, the first correction amounts 
are as shown in Fig. 21, and oiay a part of the 
elements is coxxected as in the case of the first 

15 correction on the one-dimenpional adaptive base group 
with the base number "O". The immediately previous 
error E of the first correction is "16199. 19'', and the 
error E becMoes "16199.14" by the correction, thus the 
error is slightly reduced. The second correction 

20 amounts are as shown in Fig. 22, The error E after the 
correction is "16199.07". Such correction is repeated 
by the error convergence, thereby the error E is 
reduced to about "4749". 

Wxen the error has conveirged, the next difference 

25 coded image f2(x,y) is obtained based on the expression 
(3). The difference coded image f2(x*y) is thi® result 
of subtraction of the reconstruction image fo(x,y) 
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reconstructed from the one-dimensional adaptive base 
group with the beise number "0" and the reconstruction 
image /,(x,3>) reconstructed from the one-dimensional 
adaptive base group with the base number from the 

5 input image f(x,7). 

In this manner, the difference coded image is the 
data component obtained by subtracting the 
reconstruction images reconstructed from all the 
correction-completed one-dimensional adaptive base 

10 groups from the input image. With respect to the 
difference coded image f 2(22,7), the initial one- 
dimensional adaptive base group with the base number 
"2" is selected, and correction is performed on the 
one-dimensional adaptive betse group based on the 

15 expression (2). in this manner, the numbed of one- 
dimensional adaptive base groups is increcused. 

In the. numerical example, when the correction of 
the first one-dlmenslonal adaptive base group has been 
completed, the ezxor B is about "16199", and when the 

20 correction on the second base group has been completed, 
the error E is about "4749" • Then, when the correction 
on the third base group has been completed, the error E 
is about "3312", and when the correction on the fourth 
base group has been completed, the error E is about 

25 "671". In this numerical exan^le, as the allowable 
number of the base groups is "4", the process ends at 
this stage by the detenoinatlon of the number of base 
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groups (step S28) regardless of the error E value. In 
a case were tlie error lower liialt In tlie error lower 
limit determination (step S26) is set to "1000", as tlie 
eicxor becomes less than the set lower limit in the 
5 middle of the fourth correction, the process ends at 
that time« 

However, the above arrangement, where the 
correction ±s terminated in the middle without 
increasing the number of base groups even though the 

10 error can be further reduced, is significemt in the 

point of high-speed processdLng^ but not advantageous in 
the point of approximation performance. Accordingly, 
the completion determination in the error lower limit 
determination (step S26) may be arranged such that« in 

15 correction on one -dimensional adaptive base group where 
the error becomes less than the lower limit, completion 
determination is made when the error has converged. 

The predetermined number of base groups used in 
the number of base groups determination processing 

20 (step S28) may be set to an infinite number, however, 
if the error allowable range used in the error lower 
limit determination (step S26) is small, there is a 
high probability that a very large number of base 
giroups are xregulred. Accordingly,* the number of base 

25 groups is previously limited, theireby the above coding 
can be performed with data amount with upper limit. 

The coded data, . encoded by the above method, is 
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decoded to a decoded Image £daeed«(3c,y) as follows. 

In the above expression, means tlie number of 
5 selected and corrected base groups. 

In this manner « In the coding method according to 
the second embodiment, decoded data oan be obtained 
from coded data encoded by simple processing • 

Fig. 23 shows four one- dimensional adaptive base 
10 groups obtained In the numerical exan^le, and earrays of 
8x8 numerical values corresponding to decoded images 
reconstructed from the base groups. 

In the numerical example, the image to be encoded 
is an 8x8 luminance value image for the sake of 
15 simplification, however, sucdi small data size has 

almost no meaning In the point of data compression. It 
is preferable that coding Is performed on larger sized 
data as an example of image data coding for this 
puzrpose. 

20 For example. Fig. 25 shows reconstructed images 

obtained by performing the above coding, on a 100x100 
pixel image as shown in Fig* 24 and reconstructing from 
the coded image. 

In Fig. 25, the reconstructed images are obtained 

25 from processings using one base group, two base groups, 
five base groups, ten base groups, and twenty base 
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groups. As it is understood from this escampXe, 
sufficient approximation to the original input imag^ 
can be attemied in the case of about twenty base groups* 
If one pixel value of the 100x100 pixel image as data 
5 to be encoded is a 4 -byte floating point « the data 

amount is 4 bytesxl00xl00=40000 bytes. If each element 
value of one-dimensioneil adaptive base is also a 4-byte 
floating point, the data amount of twenty base groups 
is 4 b3rtesx(100[the number of elements of X-directional 

10 one-dimensional adaptive bases ]<i-100 [the number of 
elements of Y-directional one-dimensional adaptive 
bases] )x20< the number of base groups) =16000 birtes. 
Thus, the data cosrpression has been achieved^ 

Actually, in the case of general image as shown 

15 in Pig. 24, as one pixel value is represented by 1 byte, 
the data amount is 1 bytesxl00xl00=sl0000 bytes. In . 
this case. If each element value of one- dimensional 
adaptive base is also a 4-byte floating point, the data 
amount is increased « However, in the case of general 

20 image, as the precision of 4 bytes is not necessary for 
the value of each element of one-dimensional adaptive 
base, precision of 8 bits or 6 bits is sufficient. 
Accordingly, it may be arranged such that only upper 
and lower limits of the respective one -dimensional 

25 adaptive bases are held with the 4 -byte floating point 
precision, and the values of elements of the one- 
dimensional adaptive base are rounded to a desired 
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number of bits by using the upper and lower limits* 

Fig. 26 shows decoded images reconstructed frcHn 
coded Images in a case vrtiere the number of base groups 
is twenty and the bit numbers of adaptive bases are 
5 respectively rounded to 8-bits, 6-bits and 4-*bits. The 
data amount of the rounded 8 -bit image is {1 byte [8 
bits lx( 100 [the number of X-directional one-dimensional 
adaptive base elements] +100 [the number of Y-directional 
one-dimensional adaptive base elements I<f4bytesx4 [upper 

10 limit necessary for 1 hase group/number of held lower 
limit data] }x20[ the number of base igroups]«4320 bytes. 
Thus, the data amount is compressed. In the case of 6- 
bit image, the data amount is 3320 bytes, and in the 
case of 4 -bit image « the data amount is 2320 bytes. 

15 The rounding of the values of one-dimensional 

adaptive base elements is not limited to the above- 
described method, but any other method such as rounding 
using a predetezxnined absolute value may be en^loyed. 
Further, the rounding of the values of one-dimensional 

20 adaptive base elements may be performed after the 
completion of coding using plural one-dimensional 
a.daptive base groups, however, there is a probability 
that the error is accumulated. Accordingly, it is 
preferable that the rounding is performed upon 

25 completion of correction on one one-dimensional 

adaptive base group then a difference coded image to be 
used for correption on the next one-dimensional. 
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j^daptlve base group As obtained by using tbe rounded 
one-dlmenslonal base group. 

Furtber, in a case where the above-described 
coding metbod is applied to a larger sized image of, 
5 e.g., 1280x960 pixels, as the number of one-diroenslonal 
adaptive base Elements is large, the error convergence 
cannot be easily attained. In such case. It may be 
arranged such that the image Is divided into bloclcs 
having a predetermined size of, e.g., 50x50 pixels, and 

10 the above-described coding Is performed on the 
respective blocks. Fig. 27 shows a decoded Image 
obtained by performing the 50x50 pixel size block 
division and coding on the image in Fig. 24 and 
decoding on the coded image. In this case. In an 

15 upper-left 50x50 pixel block, the number of base groups 
is 8, and in upper-right, lower-left and lower-right 
blocks, the numbers of base groups are 10, 7 and 12. 
The one-dimenslbnal adaptive base elements are 
respectively rounded to 8 bits. The size of coded data 

20 is 4292 bytes including upper-limit and lower-limit 
retention data. In comparison with the case of 
.encoding a 100x100 sized image with 8 -bit rounding 
without division, ttie data. amount is somewhat smaller. 
In this manner, as an dLnput Image is divided into 

25 appropriate, sized blocks and coding is performed on the 
respective blocks, coding with a small number of base 
groups can be realized in a simple, structured block. 
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and the data amount can be reduced. Note tlxat if the 
block size is too snxaXl, the advantage of data 
compression by each block is reduced as in the case of 
the above -described 8x8 image, and fiirther, the upper 
5 and lower limit data are dLnczreased. Accordingly, it is 
preferable to set an appropriate block size* 

The block size may be adaptively determined for 
an image to be encoded, but the block size may be 
previously set to a predetermined size. In the case 

10 where the block size is a predetermined size, 

remainder(s) may occur upon division. For example, in 
a case where an input image having a size of 1280x960 
pixels is divided by 50x50 pixels from an upper left 
corner, horizontal 30 pixels remain in a right end 

15 portion and 10 pixels remain in a lower end portion. 
In this case, coding may be performed on the right end 
portion on the assumption that it is divided by 30x50 
pixels, on the lower end pozrtion on the assumption that 
it \s divided by 50x10 pixels, and on a lower right 

20 portion on the assunq^tlon that it is divided by 30x10 
pixels. Further, in the case of coding on all the 
image divided by 50x50 pixels, coding may be performed 
on the assuoq3tion that 40 pixels in the lower end 
portion, 20 pixels from the left and 40 pixels from the 

25 bottom in the lower right portion are "O". 

As described above, in the second embodiment, a 
discrete two-dimensional gray-sceile image f (x,y) 
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defined in a finite range is encoded to plural discrete 
one-dimension£a adaptive base groups Xi{x) ^ Xi(y)- As a 
result, in comparison with the first embodiment, even 
in a case where an image to be encoded is a .natural 
5 image, coding with high precision can be peacformed* 

* 

<Third Biibodiment> 

In a third embodiment as a modification to the 
above-described second embodiment, a discrete two- 

10 dimensional gray-scale image f {x,y) defined in a finite 
range is divided into blocks and converted to plural 
discrete one-dimensional adaptive base groups X^'\(x), 
X^'^i(y) by each block, and coding is performed on each 
block. In this embodiment, as the apparatus 

15 construction is the same as that of the first 

embodiment, the explanation thereof will be omitted. 

Fig. 3 is a flowchart showing the processing 
according to the third embodiment. Hereinbelow, a 
processing procedure according to the third embodiment 

20 will be described with reference to Fig. 3« 

First, in the image input (step S30), an input 
image f (x,y) which is a discrete two-dimensional gray- 
scale image to be encoded is inputted. As in the case 
of the first and second embodiments, the definition 

25 areas of x and y are integers having ranges 0:sx<xbax and 
0^<ynax. 

Next, in image division processing (step S31), 
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the input linagia Is divided into plural windows N^'^(K,y) 
having a size of L^r Ly (Lx and Ly are non-negative 
Integers), expressed as follows. 

Note that 5 C ^® integers equal to or 
greater than "0". The definition ranges of each window 
is 0^<Lx, 0^<1»Y. Further, in a window where xh-^Lj^x^ 

10 or y+^Lysynax holds, it may be eunranged suoh that the 
range of x+lL^cSiXinax or y+^ySrymax is rounded down as a 
window having a size sin£J.ler than Lx, Ly 

Next, window selection processing is performed . 
(step S32). One window W^'^(x^y) is selected from the 

15 windows obtained by dividing the input image by the 
Image division processing at step S31. The order of 
selection is not particularly limited as long as one 
un-selected window is selected. 

Next, base grouping processing (step S33) is 

20 performed on the window W^'^(x,y) selected in the window 
iselection processing at step S32. The selected window 
W^'^{x,y) is converted into plural discrete one- 
dimensional adaptive base groups a^'\(x), S**^i(y)* The 
base grouping processing may be performed by using a 

25 similar method to that of coding to plural one- 
dimensional adaptive base groups as described in the 
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second embodiment. The definition ranges of one- 
dimensional adaptive base groups X^'^i(x), Y^-^i{y) are 
basically 0^<Lk and 0^<Ly. Further, in the above- 
described window ^ere x+|LacaSaiax or y+^Lysymax holds, it 

5 may be arranged such that, assuming that the window 
o u u u 

size is O^Jc<Lx and Osy<Ly hold. The image 

division pxt>cessing at step S31 is. more particularly, 

similar to the division by a predetermined blocflc size 

described in the second embodiment. 

10 Since the base grouqping processing at step S33 is 

similar to that of the second embodiment « the detsuLled 
explanation thereof will be omitted. When the 
conversion of the one window W^'^(x,y), selected in the 
window selection at istep S32 to one-dimensional 

15 adaptive base groups by the base grouping processing at 
step S33, has been completed, the process proceeds to 
selection completion deteimination processing at step 
S34. 

In the selection completion determdLnation 
20 processing at step S34, it is determined whether or not 
all the windows have been selected. If there is an 
unselected window, the process returns to the window 
selection at step S32, in lAich the unselected window 
is selected, then the conversion of the window to - 
25 plural one-dimensional adaptive base groups is 

pez^ormed by the above-described base grouping at step 
S33. If it is determined all the windows have been 
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seleclzed, tlie process proceeds to DCT trsmsfomi 
processing at step S35. 

In the DCT transform processing at step S35^ each 
of the pltiral discrete one-dimensional adaptive base 
5 groups X*'^i(x) . Y^'^i(y) of each window W^'^(x,y) , 

generated in the base grouping processing at step S33, 
is discrete-cosine transformed to DCT vectors 0^*^i(x), 
V^'^iCy) • The discrete cosine transform on the 
respective one-dimensional adaptive bases is performed 
10 by using the following transform eaqg^ression* 




When x=0 holds « (^==1/72. Further, when »*0 holds, 
15 Ck«1 holds* Similarly, when y^O holds, |^«l/-y/2 Isolds, 
and when yi^O holds, Cy»l holds. 

In the above transform, all the discrete one- 
dimensional adaptive base groups X^*\(x), Y^'^iCy) 
generated in the base grouping processing at step S3 3 
20 are transformed to DCT vectors U^'^x(x)r V^'^i(y)- 

Next, in quantization processing at step S36, 
quantization is performed on all the DCT vectors 
a^'^i(x), V^'^i(y) obtained in the DCT transform 
processing at step S35, thereby quantized bases Uq^'\(x), 
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^q\(7) generated. The quantization is performed 
as follows by using one-dimensiomuL quantization 
coefficient vectors Qx(x) and Qy(y) having the same 
number of DCT vector elements. 



y",(y)\ 



fi,(y) 



l^j means a maximum integer not greater than a. 
For example, holds. In the present embodiment, 

10 rounding down is performed as above, however, the 
integer may be obtained by rounding off. 

As in the oase of JPEG quantization Coefficients, 
it is preferable that the quantization coefficient 
vectors Qx(x) and Qy(y) are increased as the x 

15 component is Increased. Further, the values of the 

quantization coefficient vectors ftc(x) and Qy(y) may be 
previously determined in correspondence with the ranges 
of DCT vectors and resolutions obtained in the 
respective frequency components. 

20 Finally, the quantized bases Uq;^'^i(x), Vq^'^i(y) 

obtained in the quantization processing at step S36 are 
entropy ••encoded at step S37. In the entropy coding 
processing, all the quantized bases Uq^'^i(x) , V<i'\lY) 
are handled as data to be coded. As the method of 
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entropy coding r well-known coding methods such as the 
Huffman coding or Arithmetic coding may he «nployed. 
Then« the entropy-coded quantized bases, the number of 
bases by window, and index information necessary for 
5 decoding such as window size, are recorded as a part of 
Ifhe coded data, and the process ends. The index 
information may be omitted if a previously-sta n d ar d i zed 
index information is used. 

In the third embodiment « in the DOT transform 

10 processing at step S35, discrete cosine transfozm is 
performed directly on plural discrete one-dimensional 
adaptive base groups X^'^i(x) , Y^'^i(y), however the 
present invention is not limited to this arrangement. 
It may be arranged such that the respective one- 

15 dimensional adaptive base groups , S*'^i(y) are 

further divided, then the divided base groups are 
subjected to discrete cosine transform, quantization, 
and entropy coding. 

To decode the coded data obtained by the above- 

20 described method to a decoded image faAoode(3c,y) # the 
quantized bases ng^'^i(x) , Vq^'^i(y) are generated by 
entropy decoding and inverse-quantized while the index 
information is appropriately used, thereby decoded DCT 
vectors TSaeca<J\M ^ y^e^\{Y) are reconstructed, and 

25 inverse discrete cosine transform is performed on the 
reconstructed decoded DCT vectors, thereby decoded one- 
dimensional adaptive bases Xddoodo^'^x(x) « Xdeeoda^'^i(y} are 
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reconstructed. Next, based on the reconstructed 
decoded one-dimenslonal adaptive bases Xdecode^'''i(3c) * 
Ydecode^'^{y) ' decoded windows Waeoode^'^Cx.y) is generated 
as follows. 

5 

In the above expression, Ic^'^ is the number of 
selected and corrected base groups by window. The 
10 decoded image fdecode(x.y) is obtained by combining the 
generated decoded windows Wdecode^'^{x,y) generated as 
above . 

In the third embodiment, a difference coded image 
is generated by obtaining a reconstructed image from 

15 the generated discrete one-dimensidnal adaptive base 
groups X^-^x(x) , Y^'\{y) as in the case of the second 
embodiment. As the error is absorbed by quantization, 
it may be arranged such that upon generation of each of 
the sequentially generated one-dimenslonal adaptive 

20 base groups, the DCT transform at step S35 and the 
quantization at step S3 6 are performed, then inverse 
quantization and inverse discrete cosine transform are 
performed on the quantized bases Oq*'\(x), \r^\(Y) ^ 
method similar to that of the decoding, thereby the 

25 reconstructed decoded one-dimensional adaptive bases 
Xd0code^'^x(ac) , Ydecode^'^(y) are generated, then a 
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reconstructed image Is obtained by using tbe 
reconstructed decoded one-dimensional adaptive bases, 
thereby a difference coded image is generated • 

Fig. 28 shows an example Of a decoded image 
5 obtained by applying the above coddLng and decoding to 
the image in Fig. 24. In the coding, the image is 
divided into 8x8 pixel blocks (Lx=Ly=8) and coding is 
performed by block. In this exair^le, the DCT transform 
and the quantization are performed upon generation of 

10 each one -dimensional adaptive base ^oup, then inverse 
quantization and inverse discrete cosine transform are 
pex^formed, and a difference coded image is generated by 
using the result of inverse DCT transform. As the 
error due to quantization is absorbed upon generation 

15 of next one-dimensional adaptive base group, the 

accumulation of quantization error can be prevented. 
Regarding remainder (s) which occur upon division into 
8x8 pixel blocks, coding is performed on the assumption 
that the image has all 8x8 pixel blocks and the values 

20 of portions other than the image area are "0". Further, 
the quantization coefficient vectors Qx(x) and Qy(y) 
are as shown in Fig. 29. In this case, the data amount 
is, including information necessary for decoding (image 
size: 4 bytesx2, the number of base groups of each 

25 block; 1 bytexthe number of blocks [13x13 groups], 
quantization coefficient vectors: 4 bytesx8)., 3790 
bytes. That is, the data amount is further reduced 
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Willie the' image has quality equal to or higher than 
that of 8 -bit rounded image in the second embodiment. 
In this example, the image is divided into 8x8 pixel 
blocks and coding is performed by blocks however, other 
5 block size such as 20 x 20 pixels may be used upon 
division. 

In the coding method described in the third 
embodiment, as in the case of the second embodiment, an 
input image is divided into plural windows and base 

10 grouping is perfoxmed, thereby the number of base 

groups corresponding to each window can be variably set. 
Accordingly, in a window having monotonous density 
distribution as shown in Fig. 5^ coding with reduced 
error can be performed with a reduced number of base 

15 groups. On the other hand, in a window having density 
distribution of natural image or the like, coding can 
be performed with a large number of base groups. Thus 
the number of bause groups can be optimized. Further, 
as the base groups are discrete cosine transformed then 

20 quantized and entropy encoded, higher efficiency coding 
can be realized. 

As described in the third embodiment « a discrete 
two-dimensional gray-scale image f (x,y) defined in a 
finite range is divided into plurea blocks, then plural 

25 discrete one-dimensional adaptive base groups 

Xdecode^'^i(2c) , Ydecode^'^i{y) are generated by block, and the 
base groups are encoded. 
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<Fourth Exabodiinent> 

In a fourtii embodiment as a modification to the 
third embodiment, a discrete two-dimensional gray-scale 
5 Image f (x,y) defined In a finite range Is subjected to 
two-dimensional discrete cosine transform and 
quantization, thereby a quantized frequency image 
f'^'^id*^) is generated, and encoded to plural discrete 
one-dimensional adaptive base groups X^*\{x} , Y"'\(y.). 

10 That Is, the two-dimensional image is converted to 
frequency component data (represented in frequency 
space) and subjected to the above-described coding 
' using adaptive bases. 

In the fourth embodiment, the apparatus 

15 construction is the same as that of the first 

embodiment.. Hereinbelow, the processing according to 
the fourth embodiment will be described with reference 
to the flow€3hart of Fig. 4. 

First, in the image input (step S40), an input 

20 image f (x,y) as a discrete two-dimensional gray-scale 
ima^e to be encoded is inputted. In this embodiment, x 
and y have limited definition ranges similar to those 
in the second embodiment, and are Integers as in the 
case of the second embodiment. 

25 Next* two-dimensional DCT transform processing is 

performed (step S41). !Che Input image f(x,y) is 
divided into plural images W^^(x,y) haying a 
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predetermined size of, e.g., 8x8 pixels. Ttie divided 
images W^^{x,y) are similar to the windows W^^(x,y) 
described in the third embodiment. At step S41, two- 
dimensional discrete cosine transform is performed on 
5 the respective divided images W^'^Cx^y) . . 

Next, the two-dimensional discrete-cosine 
transformed data are quantized (step S42). The 
quantization processing is performed by using a 
predetermined quantization coefficient Q(x,y) , thereby 
10 quantized Images Wq^(x,y) are generated. That is, 
processings similar to the JPEG coding step of two- 
dimensional discrete cosine transform and quantization 
are perfoicmed. Since the transform is similar to the 
JPEG transform, the detailed explanation thereof will 

15 be omitted. 

In the fourth embodiment, the input image f(x,y) 
is divided into 8x8 pixel sized images W^^(x,y) and 
subjected to two-dimensional discrete cosine transform, 
and subjected to quantization by using the quantization 

20 coefficient Q{x,y) to increase a value in a high 
frequency, however, the present invention is not 
particularly limited to this arrangement. For example, 
the input image may be divided by another size, or the 
quantization may be peirf ormed by using another 

25 quantization coefficient. 

Next, frequency selection processing is performed 
(step S43). In this procesfsing, frequency parameters u 
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V are selected, and a frequency image ^''''d.t) is 
generated. The frequency parameters u, v are integers 
equal to or greater than "O". As the Input image 
f (x,y) is divided into 8x8 pixel sized images W^^(x,y) 
5 in the two-dimensional DCT transform (step S41), the 
parameters are integers up to "7". .Accordingly, the 
frequency parameters u, v have values "0" to "7". In 
this, eoibodiment , one of 8x8«64 parameter combinations 
is selected. The generated frequency image f'*'''(i,5) is 
10 expressed as follows using the quantized images 
Wq^^(x,y) generated in the quantization, 

15 As e3q3ressed above, in the frequency' image 

f'^d*?)* selected u, v frequency components in the 
respective quantized images Wq^^ ( x , y ) are arrayed . 

Next, in the Isase grouping processing (step S44), 
the frequency image f'^^d^t) generated in correspondence 
20 with the selected frequency parameters u, v is 

converted to pliiral discrete one- dimensional adaptive 
base groups X^'^'id), Y'*'\(t) . Since the processing is 
similsu: to the coding to plural one- dimensional 
adaptive base groups described in the second embodiment, 
25 the explanation thereof will be omitted. 

In selection completion determination (step S45), 
it is determined whether or not all the frequency 
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parameters u, v have been -selected. In the fourth 
embodiment, as there are 64 combinations of frequency 
parameters u, all of the combinations are selected. 
When the base grouping of the frequency images f^'^'Cl,^) 

5 corresponding to the arespective frequency parameters u. 
V in the base grouping (step S44) has been completed, 
the process proceeds to entropy coding (step S46). If 
it is determined that all the 64 combinations of 
frequency parameters u, v have not been selected, the 

10 process returns to the frequency selection (step S43), 
In which an unselected combination of frequency 
parameters u, v is selected, then base grouping of the 
frequency image f'^-'^d.^) corresponding to the selected 
frequency parameters u, v is performed. 

15 In the ent3X>py coding (step S46), the base groups 

y^^'^i^). Y"'''x(^) generated in the base grouping (step 
S44) are entropy encoded, then recorded, with index 
information necessaicy for reconstruction, as coded data, 
and the process ends. The processing is similar to 

20 that described in the taiird embodiment. 

As in the case of the third embodiment, in the 
method for generating a decoded image from the coded 
data, first, one-dimensional base groups are 
reconstructed by entropy decoding with the index 

25 information, then a frequency image is reconstructed by 
using the base groups. Then quantized Images are 
generated frcwa the frequency images, then inverse- 
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quantization is performed^ and inverse two-dimensional 
disorete-cosine transform is perforiooed, thereby a 
decoded iisiage can be reconstructed* 

In the third embodiment « the input image is 
5 spatially divided and encoded « while in the fourth 
embodiment, the input image is divided in frequency 
space and encoded ♦ In the fourth embodiment, one- 
dimensional base grouping is made from the image 
divided in frequency space, however, it. may be arranged 

10 such that the image divided in the frequency space is 
further spatially divided before base grouping « 
Further, in the entropy coding (step S46)^ the 
generated base groups are directly entropy encoded, 
however, it may be arranged such that the one- 

15 dimensional adaptive base groups are quantized and 

entropy encoded. Further, as in the case of the thir d' 
embodiment, it may be arranged such that further 
discrete cosine transform (one-dimensional) then 
quantization are performed, and entropy coding is 

20 performed. 

As described above, a discrete two-dimensional 
gray-scale image f (x,y} defined in a finite range is 
two-dimensional discrete-cosine transformed and 
quantized thereby a frequency image £^'^{%,t,) is 

25 generated, and encoded to plural discrete one- 
dimensional adaptive base groups X°'^i(|), Y°'^i(t) » 
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<Pifth Eiiibodlm6nt> 

In the above-described first to fourth 
embodiments, coding of two-dimensional data is 
described. However, the present invention is not 

5 limited to two-dimensional data but is applicable to 
other multidimensional data. In a fifth onibodiraent as 
a modification to the second enibodiment, discrete 
three-dimensional data f(x,y,z) defined in a finite 
range is encoded to plural discrete one- dimensional 

10 adaptive base groups Xi(x) , Yi(y)# Zi(z)* 

As discrete three-dimensional data to be encoded, 
discrete density distribution data in three-dimensional 
space or discrete time-series data of discrete two- 
dimensional gray-scaae image may be used. In this 

15 embodiment, each element of the three-diroehslonal data 
(in the case of discrete time-series data of discrete 
• two-dimensional gray-scale image, a pixel of the two- 
dimensional grayscale image at predetermined time) is 
represented by 1 byte. 

20 First, such three-dimensional data f(x,y,z) to be 

encoded is inputted. As in the case of the second 
embodiment, x, y, z are integers having predetermined 
definition ranges 0^<x^, Osy<ynaz# and O^zKz^. As in 
. the case of the second embodiment, coding is performed 

25 by correcting one-dimensional adaptive base groups 

Xi(x), Yi(y), Zi(z) based on the following error E and 
correction emounts AXi(x}, AYi(y), AZx(z). 
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In the above e^resslon^ fi(x,y,z) and fiix^y^z) 
5 are similar to the difference coded image fi(x,7} and 
reconstructed image fjix^y) in the second embodiment. 
The only difference is that the dimension is three- 
dimensional. Since other parameters are similar to 
those in the second embodiment, the explanations 

10 thereof will be omitted. 

The three-dimensional data is encoded to the one- 
dimensional adaptive base groups Xx(x), Yi(7), Zi(z) by 
correcting the one-dimensional base groups based on the 
error B and the correction amounts AXi(x) , AYi(y} , 

15 AZx(z), by a similar method to that described in the 
second embodiment. Assuming that one-dimensional 
adaptive base group corrected frdm selected one- 
dimensional adaptive base group Xi(x), Yi(y)r Zi(z) are 
X'i(x), Y*i{y), Z'i(z), the correction is performed as 

20 follows. 
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Finally^ when the error E Is equal to or a 
5 predetermined value, or the number of bases becomes a 
predetermined number « the one-dlmehslonal adaptive base 
groups Xi(x), Yx(y) , Zi(z) selected and corrected by 
that time are recorded, and the process ends. Since 
the processing here is similar to that described In the 
10 second embodiment, the detailed escplanatlon thereof 
will be omitted. In this case, decoded data 
fdeoo<io(x,y,z) reconstructed from the one -dimensional 
adaptive base groups Xi(x) , Yi(y), Zi(z) is as follows. 

15 ^ 

In the above expression, k is the number of base 
groups. In this manner, even if the dimension of data 
to be encoded becomes higher, coding can be realized by 
20 obtaining error and correction amoiints as described 
above. In the present embodiment, the input three- 
dimensional data is directly encoded to one-dimensional 
adaptive bases, however, as in the case of the above- 
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descril^ed third embodiment, tlie three-dimensional data 
may be divided by a predetexmlned range or divided in 
frequency space by discrete cosine transform. 

As described above, discrete three-dimensional 
5 data f (x,y,z) defined in a finite range is encoded to 
plural discrete one-dimensional adaptive base groups 
Xi(x), Yi(y), Zi(z), 

< Sixth Embodiment > 

10 In the above-described first to fifth embodiments, 

as an error evaluation function, the second ^ower of 
error of each element is enq^loyed, however, the coding 
method of the present invention is not limited to the 
above evaluation function, but is applicable to other 

15 error evaluation functions. In a* sixth embodiment as a 
modification to the second embodiment, assuming that a 
is reference data. I.e., data to be encoded, and b is 
evaluation data, i.e., data reconstructed from coded 
data, an error evaluation function i:{l/2x(a^-ab)^} ±s 

20 employed when a discrete two-dimensloneLL gray-scale 
image f (x,y) defined In a finite range is encoded to 
plural discrete one-dimensional adaptive base groups 
Xi(x), Yi(y). 

First, a discrete two-dimensional gray-scale 

25 image f (x,y) to be encoded is inputted. As in the case 
of the second embodiment, x, y are integers having 
predetermined definition ranges .0:s<xbax» 0^<yaiax. With 
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regard to the two-dimenslonaa gray-scale image f(x,y), 
coding is performed by correcting the one-dimensional 
adaptive base groups Xi(x) , Yx(y) based on the 
following error K and correction amounts AXi(x) , AYiCy), 
5 as in the case of the second embodiment • 

In the above expression, fi(x,y) and /,(x,y) are 
10 similar to the difference coded image fi{x,y) and 
reconstructed image //(x,y) in the second embodiment, 
therefore the explanations thereof will be omitted. 
Further, since other parameters are similar to those in 
the second einbodiroent, the explanations thereof will be 
15 omitted. 

Based on the above error E and correction amounts 
AXx(x) , AYi(y) , the one-dimensional adaptive base 
groups are corrected in a similar method to that 
described in the second embodiment, thereby coding to 
20 the one-dimensional adaptive base groups Xi(x) , Yx(y) 
is performed. Assuming that one-dimensional adaptive 
base group « corrected from selected one -dimensional 
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ade^tive base group Xi(x), YiCy). is X'i(x), Y»x(y), and 

uncorrected base group is Xi(x), Xi(y) . correction is 
perfoxmed as follows. 

Finally, wben the error E is equal to or a 
predetermined value, or the number of bases becomes a 
predetermined number, the one-dimensional adaptive base 
groups Xi(x), YiCy) . selected and corrected by that 
time are recorded, and the process ends. Since the 
processing here is similar to that described in the 
second embodiment, the detailed explanation thereof 
^ill be omitted* In this case, decoded data £decode(^#7) 
is similar to that described in the second embodiment. 

In this manner, coding is realized by using other 
error evaluation function than the second power eri:or, 
by obtaining error and correction amounts as described 
above. In the sixth embodiment, the error evaluation 
function 2{l/2x(a*-ab)*} is eniployed, however, the 
present invention is not limited to this error 
evaluation function. Any other evaluation function may 
be used as long as it becomes closer to coded data 
thereby error is reduced. For example, in the case of 
two-dimensional image, the divez^ence between 



wo 2005/074145 



PCT/JP2005/001289 



- 58 - 

difference coded Image and differentiated reconstructed 
Image may be Included in the error evaluation function. 
It is preferable that in such error evaluation function, 
parameters to be corrected, i.e., partial differential 
5 with respect to Xl(x) , Yi(y) is analytically obtained. 
However, if the partial differential cannot be 
analytically obtained, the correction amounts may be 
determined from increment /decrement of error when the 
parameters to be corrected are slightly changed. 

xo As described above, a discrete two-dimensional 

gray- scale image f {x,y) defined in a finite range is 
encoded into plural discrete one-dimensional adaptive 
base groups Xi(x), Yi(y) by using 2:£l/2x(a^-ab)^} as an 
error evaluation function. Note that the sixth 

15 embodiment is particularly applied to the second 

embodiment, however, it is also applicable to other 
embodiments • 

<Seventh Embodiment > 

20 In the above -described first to sixth embodiments, 

multidimensional data is encoded to plural one- 
dimensional adaptive bcise groups, however, the present 
invention is not limited to the above coding, but is 
applicable to coding to other form of data. In a 

25 seventh embodiment as a modification to the second 

etabodiment, a discrete two-dimensional gray- scale image 
f (x,y) defined in a finite range is encoded to plural 
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discrete two-dimensional adaptive bases Si(aCs»y8)- 

First, a discrete two-dimensionea gray-scale 
Image f(x,y) to be encoded is inputted. As in the case 
of the second embodliaeht. x and y are integers having 
5 predetexiDlned definition ranges 0 £X<acbax and 0^<ymx. 
Next, as a base, one discrete two-dimensional adaptive 
base Si(Xs,y«) is selected. If or y„ax is an even 
number, Xa and y^ are integers having definition ranges 
0sai^<(jt«x/2)+l and Osy.<(y»Ba/2)+l. If 3w or yw« is an 

10 odd nundier, Xg and y. are integers having definition 
ranges Osxs< ( x«ax/ 2 ) +0 . 5 and 0^s< {y«iax/2 ) +0 . 5 . Further , 
the suffix "1" is a base number. Although not 
particularly limited, the base number is sequentially 
selected from "0" in the present embodiment.. 

15 Next, a reconstructed image f,(Xyy) is calculated 

from the selected two-dimensional adaptive base 
Si(ac8,ya) having the base number "1" as follows. 
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i ) y z even nunber 

ii ) X % y : odd number 

in) X I even nianber, y : odd number 

/:M-||.,(f.^)-.(|.^)} . . 

hr) 3t : odd number, y ^ «ven number 

/;M-i{^.(^.t)-.(^.f)} 

The error E and correction amount hSxi^^Ys) are 
calculated by using the above reconstructed image 
5 //C^iy) as follows. 

In the above expression, fi(x,y) is a difference 
10 coded image similar to that of the second embodiment. 
Purth^, in the eacpression to calculate the correction 
amount ASi(x.,y.). C(m.n) has the following values. 
If n>0 and msO hold 
C(n,m)«l 
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If n8±l and m=0 hold« or naO and in±l hold 

C(n,m)B0«5 
If n=±l and m=»±10 hold 

C(n,m}e0.25 

5 

Notd that in the above expressions, if 2acs+n<0, 
ZXs+naaw, 2ys+ni<0, or 2ys+nsy„ax holds, C(m,n)«0 holds. 

Further, tj is a correction parameter similar to 
the parameters tlx and % described in the second 

10 embodiment. The correction is performed on the two- 
dimensional adaptive base based on the above error E 
and correction amount ASi(Xs,yfi) in a similar method to 
that described in the second embodiment, thereby the 
input image f (x,y) is encoded to the two-dimensional 

15 adaptive base Si(x8,y8). 

Regarding the correction of the base, the 
selected, two-dimensional adaptive base Sx(Xg,ya) is 
corrected as follows. In the expression, Si(X8,y8) is 
an uncorrected base prior to the correction, and 

20 S'i(Xs,ys) is a corrected base. 
S'i(Xs,ys)=Si(xe,ys)+ASi(Xs,ys) 

Finally, when the error E is equal to or a 
predetermined value, or the number of bases becomes a 
25 predetermined number, the two-dimensional adaptive 

bases Sx(Xs,y6) selected and corrected by that time are 
recorded, and the process ends. Since the processing 
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here is similar to that descsribed in the second 
embodiment, the detailed explanation thereof will be 
omitted. In this case, a decoded image f decode (x,y) 
reconstructed from the coded data is obtained as 
5 follows « 

i ) y : even number 

ii ) Xi« y • odd nundser 

fii) X •: even nunber. y • odd number 
w) X : odd number, y : even number 

: ,_w.|[i|..(£|i.|)..(i^.t))] 

In the above expressions, k is a base number of 
lb selected and corrected bases. In the seventh 

embodiment, in the generated two-dimensional adaptive 
bases Si(3C8,7s), the number of elements is about 1/4 of 
the input image f(x,y). however, the invention is not 
limited to such number but it may be arranged such that 
15 coding is performed by* using a two-dimensional adaptive 
base having a diffezrent number of elements. 
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As described above ^ in the seventh embodiment, a 
discjrete two-dimensional gray-scale Image f (x,y) 
defined in a finite range is encoded to plural discrete 
two-dimensional adaptive bases Sxtscs^ya). 

5 • 

<Eighth Embodiment> 

In the above-described first to seventh 
embodiments « coding is performed by using a one- 
dimensional adaptive hass or two-dimensional adaptive 

10 base as an adaptive base« however, the coding method of 
the present invention is not limited to this ' 
arrangement but is applicable to adaptive base having 
plural parameters • In an eighth embodiment of the 
present invention as a modification to the second 

15 embodiment, a discrete two-dimensional gray-scale image 
f (x,y) defined in a finite range is encoded to an 
adaptive base having plural parameters. 

Hereinbelow, as a particular example, coding to 
an adaptive base 6i(Ai,pi,q].,px) having four parameters 

20 Ai, px, qi and px will be described. 

First, a discrete two-dimensional gray- scale 
image f (x,y) to be encoded is inputted. As in the case 
of the second embodiment, x and y are integers having 
predetermined definition ranges 0^<s:baac# Ossy<ynax« Next, 

25 one adaptive base Gx is selected as an initial adaptive 
base* The suffix *1" is a base number. In the eighth 
embodiment, although not particularly limited, the 
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adaptive base Is sequentially selected from "0" to a 
predetermined number « 

Next« a reconstructed image f"i(x*y) is 
calculated from the selected adaptive base Gi having 
5 the base number 1 as follows. 

Next, the error B and correction amounts AAi, Api, 
10 Aqi, and Z^i are calculated as follows by using the 
above reconstructed image f "iCx^y) . 

Aft f llffcM-^fc^^fcy)-^] 



15 In the above eatpression, fi(x.y) is a difference 

coded image sljnilar to that of the second embodiment. 
Further, tja , Hp . % and ^a are correction parameters. 
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similar to the paraooieters t)x and % described in the 
second embodiment. Based on the above error E and the 
correction amounts AAi, Api, Aqx, and Apx, the 
respective parameters constructing the adaptive base 
5 are corrected by a similar method to that of the second 
eml}odiment, thereby coding to the adaptive base Gi is 
performed* 

Regarding the correction of the adaptive base, 
the respective parameters Ax# Px« qi and pi, 

10 oonstiructing the selected base 6jl are co3crected as 

follows* A'l, p'i« g'x emd p'x are corrected parameters, 
and Ai, pi, gi and px are uncorrected parameters* 
A'x = Ax + AAx 
P'x = Pi + Apx 

15 q'x « qi + Agx 
P'x = pi + Apx 

Finally, when the error E is egual to or less 
than a predetermined value, or the base number becomes 

20 a pzredetezmlned number, the respective parameters Ax# 
Px, gx and px constructing the adaptive bases Gx 
selected and corrected by that time are record- 
outputted, and the process ends. Since the processing 
here is similar to that described in the second 

25 ^bodiment, the detailed explanation thereof will be 
omitted* In this case, a decoded image fdocod©(x,y) 
reconstructed from the coded data is obtained as 
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follows. 

5 In the above expression, k Is a base number of 

selected and corrected bases. In the eighth ^bodiment, 
the adaptive base Gi having four parameters Is used, 
however, the present Invention Is not limited to this 
number of parameters, but It may be eurranged such that 
10 coding Is performed by using an adaptive base having a 
different number of parameters. 

As described above, a discrete two-dimensional 
gray- scale image f{x,y) defined in a finite range Is 
encoded to adaptive base Gi having plural parameters. 

15 

<Nlnth Embodlment> 

In a ninth embodiment, discrete convolution 
operation to two-dimensional distribution data as 
predetermined two-dimensional weight distribution data 

20 is performed. The two-dimensional weight distribution 
data Is transformed by the data coding according to the 
second embodiment to one -dimensional adaptive base 
group, and discrete convolution operation is performed 
on the two-dimensional distribution data by using the 

25 one -dimensional adaptive base group. The discrete 
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convolution can be used in^ e.g., calculation in one 
feature detection cell face in Convolational Neural 
Networks (LeCun, Y. and' Bengio, Y., 1995, 
■Convolutional Networks for Images Speech, and Time 
5 Series" in Handbook of Brain Theory and Neural Networks 
(M. Arbib. Ed.), MIT Press, pp. 255-258). In this case, 
the two-dimensional weight distribution data can be 
regarded as synapse weight distribution. 

First, discrete two-dimensional weight 

10 distribution data w(x,y) to be subjected to discrete 

convolution is inputted. As the two-dimensiotial weight 
distribution data is discrete, x and y are integers. 
Note that if the two-dimensional weight distribution ^ 
data w(x,y) is k-dimensionea weight distribution data, 

15 the data is expressed as w(xi,,xa, Xk) . Further, 

if the two-dimensional distribution data is k- 
dimensional distribution data, the data is expressed as 
A(xi, X2, :^). In the present embodiment, the two- 

dimensional distribution data is expressed as f(x,y). 

20 The result o£ discrete convolution to the two- 
dimensional distribution data f(x,y) as two-dimensional 
weight distribution data is expressed as follows. 

if V 

25 

Nesct, a one-dimensional adaptive base group Xi(x) , 
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YiCy) is generated from the dLnputted two -dimensional 
weight distribution data w(x.y) by a similar method to 
that described in the second embodiment. The suffis: 
*'l" of the one- dimensional adaptive base group Xi(z), 
5 Yx(y) is a base number. As detailed explanations here 
are similar to those in the second embodiment, the 
explanations will be omitted. The one -dimensional 
adaptive base group is not necessarily generated upon 
each convolution, but it may be arranged such that the 

10 one-dimensional adaptive base group is previously 
generated by the method described in the second 
embodiment, and the generated one -dimensional adaptive 
' base group is recorded. 

The result of discrete convolution to the two- 

15 dimensional distribution data f (x,y) by using the 
generated one-dimensional adaptive base group is as 
follows. 

■% 

20 

In conventional art as shown in Fig. 6, in 
discrete convolution of two-dimensional weight 
distribution data having 6x6 elements, two- dimensional 
weight distribution data values are independently given 
. 25 to the total thirty-six elements in the respective 
coordinates, i.e., the two-dimensional weight 
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distribution data values are sent as signals to the 
respective coordinates, thirty- six signal lines are 
required. On the other hand, in the present embodiment, 
as the two-dimensional weight distribution data w{x,y) 

5 is decomposed to the one-dimensional adaptive base 
group Xi(x), Yi(y) and discrete convolution is 
performed by using the one- dimensional adaptive base 
group, the required number of signal lines is twelve as 
shown in Fig. 7. In this manner, the conventional 

10 problem of wiring in" the convolution arithmetic unit 
can be solved. Note that in a convolution aritauaetic 
unit having an array of product -sum arithmetic elements 
for execution of the above discrete convolution, the 
computation may be performed by Inputting the one- 

15 dimensional adaptive base group Xi.(x), Yi(y) into all 
the columns and rows of the array, as shown in Fig. 7, 
otherwise, by inputting the one -dimensional adaptive 
base group Xi(x), Yi(y) into respectively only a part 
of the columns and rows, and by performing computation 

20 in oniy a part of area (63) of the array idiere both of 
Xi(x), Yi(y) are inputted, as shown in Pig. 9. 

As described above, in discrete convolution to 
two-dimensional distribution data as predetermined two- 
dimensional weight distribution data, the two- 

25 dimensional weight diistribution data is converted to 
one-dimensional adaptive base group by the data coding 
method according to the second embodiment, and discrete 
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convolution is performed on the two-dimensional 
distribution data by using the one-dimensional adaptive 
base group. 

In tbe above enibodiment, k-dimensional data w(xa.^ 
5 .... Xk) is encoded by the above-described coding 

method, thereby at least a set df k one -dimensional 
adaptive base groups Xu.{xi), xixl^z) » Xia(Xit) is 

obtained. Further, the result y of the product-sum 
operation using the above k-dimensional data A(xi, X2, 
IQ • . . , Xk) and the above one -dimensional adaptive base 
group is calculated as follows. 

15 By the above calculation, the result y can be 

efficiently obtained by product-sum operation between 
the k-diraensional data w(xx, xz, xk) and the k- 

dimensional data A(Xi, X2, Xk) as follows. 

20 y ^ ^^-^ A{x^,X^,...,X^yw{x^,^^^^ 

In addition to the embodiments of the present 
invention as described above, as it is apparent that 
the present invention can be realized by a oonqputer 
25 program as shown in Fig. 8, such conqputer program is 
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included in the scope o£ the present invention* 
Generally, a computer program is stored in a computer - 
readable storage medium such as a CD-RCM, and when the 
medium is set in a storage medium drive device of a 
5 computer then the program is copied or installed to the 
system, the program becomes executable. Accordingly « 
such computer-readable storage medium is also included 
in the scope of the present invention. 

As described above, according to the embodiments, 

10 n data to be encoded can be encoded to data of 

efficient representation format (format using adaptive 
base). For this purpose, the adaptive base is set, 
then n data are reconstructed by using the adaptive 
base, and the error between the n data to be encoded 

15 and the reconstructed n data is calculated by using a 
predetermined error evaluation function, and the 
adaptive base is corrected based on the error. 

As described above, according to the pxresent 
invention, high-efficient data coding,, more 

20 particularly, coding of distribution data in 

multidimensional space such as a two-dimensional image . 
can be realized. Further, as two-dimensional data can 
be decomposed to one-dimensional base data, the 
conventional problem in convolution arithmetic unit, 

25 i.e., the problem of wiring of two-dimensidnally 
parallelized array, can be solved. 

As many apparently widely different, embodiments 
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Of the present invention can be made without departing 
from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the 
specific embodiments thereof except as defined in the 
5 appended claims. 

CLAIM OP PRIORITY 

This application claims priorities from Japanese 
Patent Application No. 2004-024485 filed on January 30. 
10 2004 and Japanese Patent plication No. 2004-239792 
filed on August 19. 2004, the entire contents, of %rtiiah 
are hereby incorporated by xe£&reno& herein. 
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